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(54) Apparatus and method for selectively processing a scanned image 



(57) An image processing arrangement is described 
that minimizes moire patterns in scanned halftone im- 
ages (140) of a scanned image while maintaining the 
resolution of the scanned image. The arrangement in- 
cludes a filtering processor that has a modified median 
filter (142) with a specially shaped (e.g., cross-shaped) 
filter window (160). The filter window (160) allows the 
modified median filter (142) to preserve scanned text im- 
ages of the scanned image when processing the 



scanned halftone images to minimize the moire pat- 
terns. In addition, the filtering processor determines if 
an image pixel of the scanned image appears to belong 
to scanned continuous tone images of the scanned im- 
age prior to processing the image pixel. The filtering 
processor does not process that image pixel and the pix- 
el value of that image pixel is left unchanged if the image 
pixel appears to belong to the scanned continuous tone 
images. 
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Description 

The present invention pertains to image process- 
ing. More particularly, this invention relates to apparatus 
and a method for selectively processing a scanned im- 
age such that (1 ) moire patterns in scanned halftone im- 
ages of the scanned image are minimized and (2) the 
resolution of scanned continuous tone and/or text imag- 
es is maintained. 

In the field of digital imaging, halftoning technique 
can be used to create images (i.e., half toned images or 
halftone images) with varying levels of grey and color 
saturation and with varying color shades. Using this 
technique, patterns of closely spaced tiny dots of ink of 
the appropriate color, or black, are deposited on paper 
or other imaging media to achieve the desired halftone 
image. Halftone images can be created for display on 
an electronic monitor such as a CRT (Cathode Ray 
Tube) display or an LCD (Liquid Crystal Display) moni- 
tor, or on paper by a printer The dots are small enough 
and closely spaced enough to be seen by the human 
eyes at normal viewing distance as a continuous tone 
image when, in fact, it is a discontinuous image made 
up of numerous dots. The varying levels of gray scale 
or color saturation are achieved by varying the sizes and 
spacing of the dots appropriately throughout the image, 
while the varying color shades are produced by super- 
imposing the color and grey scale dots, the relative sizes 
and spacing of the color and black dots determining the 
composite shade of color or grey scale level. Figure 1 A 
shows a typical halftone image 10 that has a section 1 5 
enlarged. 

In some applications, it is typically desirable to re- 
produce a halftone image (e.g., the halftone image 10 
of Figure 1A). One typical approach to reproducing a 
halftone image is to use an image scanner to scan the 
halftone image. However, in scanning halftone images 
(e.g., the halftone image 10 of Figure 1A), a visible pe- 
riodic or almost periodic density pattern typically occurs 
on the scanned halftone image when the relation be- 
tween the dot pitch, the reading density, and further the 
periodic characteristics of tone reproduction (i.e., re- 
halftoning) involves a delicate phase or frequency de- 
ference. This periodic density pattern is typically re- 
ferred to as moire or "beat" pattern. Because the moire 
or "beat" pattern results from the incorrect reproduction 
of halftone dots of the original halftone image, it typically 
renders the scanned halftone image less legible and of 
poorer visual quality. Figure 1B shows the scanned im- 
age 17 of the halftone image 10 of Figure 1 A. As can be 
seen from Figure 1 B, moire pattern can be observed on 
the scanned image 17. 

The formation of the moire pattern depends on the 
following factors: (1) the halftone screen frequency, (2) 
the scan frequency, (3) the angle between the scan di- 
rection and the halftone screen, and (4) the scanner ap- 
erture size and shape, etc. For example, as can be seen 
from Figures 1C and 1 D, halftone dots 20 and 21 are of 



2 

the same size before being converted into scan pixel 
values (i.e., before digitization). After digitization, half- 
tone dot 20 of Figure 1C consists of one black pixel (i. 
e., the pixel 20c) and halftone dot 21 consists of two 

5 black pixels (i.e., the pixels 21 b and 21 c). A band of two- 
pixel dots appears darker than a band of one-pixel dots, 
thus producing the "beat" pattern or patterns. In the fre- 
quency domain, the moire patterns are seen as aliased 
frequency components resulting from the scanning of 

10 screened art. when a scanned halftone image is again 
half toned for printing, the visibility of moire patterns can 
be greatly intensified, particularly if a cluste red-dot dith- 
er matrix or fixed threshold is used for the halftoning. 
A number of prior art techniques have been pro- 
fs posed for reducing moire patterns in scanned halftone 
images. One prior art approach to reducing moire pat- 
terns is to process the halftone image with a low pass 
filter prior to or immediately after scanning the image. 
The low pass filtering can be done using optical ap- 

20 proaches such as increasing the size of the scan aper- 
ture (i.e., blurring) or electronic approaches using a dig- 
ital low pass filter. 

Disadvantages are, however, associated with this 
low pass filtering approach. One disadvantage associ- 

25 ated is that while low pass filtering reduces moire pat- 
terns, it also degrades the image fidelity. This is due to 
the fact that low pass filtering degrades the high fre- 
quency components of the image, when the filtered half- 
tone image includes both a scanned halftone image and 

30 a text and/or continuous tone image, the resultant text 
and/or continuous tone image is typically undesirably 
blurred due to the low pass filtering. 

The present invention seeks to minimize moire pat- 
terns in a scanned halftone image. 

35 According to an aspect of the present invention, 
there is provided a method of processing a scanned im- 
age as specified in claim 1 . 

According to another aspect of the present inven- 
tion, there is provided a method of processing a scanned 

40 image as specified in claim 4. 

It is possible with the present invention to maintain 
the resolution of a scanned continuous tone and/or text 
image. 

A preferred embodiment can selectively process a 
45 scanned image such that (1) moire patterns in the 
scanned halftone image portion of the scanned image 
are minimized and (2) the resolution of the scanned text 
and continuous tone image portion of the scanned im- 
age is maintained. 
50 in accordance with one embodiment of the present 
invention, a filtering processor is provided to minimize 
moire patterns in scanned halftone images of a scanned 
image while maintaining the resolution of scanned text 
images of the scanned image. The filtering processor is 
55 designed to have a modified median filter with a special- 
ly shaped (e.g., cross-shaped) filter window that allows 
the modified median filter to preserve straight lines with- 
in the scanned image when processing the scanned 
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halftone images of the scanned image to minimize the 
moire patterns. In doing so, the filtering processor mim- 
imizes the moire patterns in the scanned halftone imag- 
es of the scanned image without reducing the resolution 
of the scanned text images of the scanned image. $ 

In addition, the filtering processor also reduces the 
degradation of scanned continuous tone images in the 
scanned image when minimizing moire patterns in the 
scanned halftone images of the scanned image. The fil- 
tering processor does this by first determining if an im- 10 
age pixel of the scanned image is similar to its adjacent 
pixels (i.e., if the image pixel belongs to the scanned 
continuous tone images). If so, the pixel value of that 
image pixel is left unchanged because that image pixel 
does not exhibit the high frequency texture typically as- is 
' sociated with a scanned halftone image. If the image 
pixel is significantly different from at least one of the ad- 
jacent pixels, then that image pixel is assumed to be part 
of a scanned halftone image, and the pixel value is re- 
placed with the output of the modified median filler By 
adding this decision stage to the filtering processor prior 
- to the median filtering operation, moire patterns in the 
scanned halftone images can be minimized while retain- 
ing details in the scanned continuous tone images of the 
scanned image. 

According to another aspect of the present inven- 
tion, there is provided image processing apparatus as 
specified in claim 10. 

Preferably; the filter window is a cross-shaped filter 
window that has a horizontal pixel window and a vertical 
pixel window intersecting the horizontal pixel window. 
Each of the horizontal and vertical pixel windows may 
have a window span of three image pixels. The modified 
median filter may be a digital non-recursive filter or a 
digital recursive filter. 

According to another aspect of the present inven- 
tion, there is provided image processing apparatus for 
a scanned image having a scanned halftone image, a 
scanned text image, and a scanned continuous tone im- 
age, comprising: (A) a first set of instructions that define 
a cross-shaped fitter window for a modified median filter, 
wherein the cross-shaped filter window allows the mod- 
ified median filter to pass through image pixels of the 
scanned text image substantially unchanged; (B) a sec- 
ond set of instructions that determine if an image pixel 
of the scanned image appears to belong to the scanned 
continuous tone image; (C) a third set of instructions that 
pass through Ihe image pixel unchanged if the image 
pixel appears to belong to the scanned continuous tone 
image; (D) a fourth set of instructions that send the im- 
age pixel and a number of adjacent pixels that fall within 
the cross-shaped filter window to the modified median 
filter if the image pixel does not appear to belong to the 
scanned continuous tone image such that moire pattern 
in the scanned halftone image is minimized without re- 
ducing the resolution of the scanned image. 

Preferably, the second set of instructions deter- 
mines if the image pixel appears to belong to the 



scanned continuous tone image by determining if the 
pixel value of the image pixel is different from that of at 
least one of the adjacent pixels by more than a prede- 
termined value. Preferably, the predetermined value is 
approximately twenty while the pixel value of each im- 
age pixel of the scanned image can range from zero to 
two hundred fifty five. 

The fourth set of instructions may further comprise: 
(I) a first subset of instructions that determine which one 
of the adjacent pixels and the image pixel has the me- 
dian pixel value, wherein when the image pixel belongs 
to the scanned text image, the image pixel has the me- 
dian pixel value; (II) a second subset of instructions that 
subtract an error value multiplied by a predetermined 
parameter from the median pixel value, wherein the er- 
ror value is initially set at zero; (III) a third subset of in- 
structions that change the pixel value of the image pixel 
to the subtracted median pixel value; (IV) a fourth subset 
of instructions that update the error value for a next im- 
age pixel by adding the difference between the original 
pixel value of the image pixel and the subtracted median 
pixel value to the error value. 

The cross-shaped filter window may have a hori- 
zontal pixel window and a vertical pixel window inter- 
secting the horizontal pixel window, wherein each of the 
horizontal and vertical pixel windows has a window span 
of three image pixels. 

An embodiment of the present invention is de- 
scribed below, by way of example only, with reference 
to the accompanying drawings, in which: 

Figure 1 A shows a typical halftone image having a 
section enlarged; 

Figure 1 B shows the scanned image of the halftone 
image of Figure 1 A, wherein the scanned image has 
moire patterns; 

Figures 1C and 1D are spatial domain illustrations 
of the cause of the moire patterns; 
Figure 2 shows a computer system that implements 
an image processing system; 
Figure 3 shows the image processing system im- 
plemented by the computer system of Figure 2, 
wherein the image processing system includes a 
moire reduction module in accordance with one em- 
bodiment of the present invention; 
Figure 4 shows in block diagram fonn.the moire re- 
duction module of Figure 3 that has a buffer and a 
filtering processor; 

Figures 5 A to 5F show various desired root signals 
(i.e., structure constraints) for the filtering proces- 
sor; 

Figure 6 shows the filter window of the filtering proc- 
essor in accordance with one embodiment of the 
present invention, wherein the filter window allows 
the filtering processor ol Figure 4 to pass through 
the root signals of Figures 5A-5F unchanged; 
Figure 7 illustrates how the filtering processor of 
Figure 4 uses the filter window of Figure 6 to proe- 
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ess the scan pixels; 

Figure 8 shows in flow chart diagram form the op- 
eration of the filtering processor of Figure 4; 
Figure 9 shows a synthetic image used to illustrate 
the effect of the parameter a used in the filtering 
processor of Figures 4 and 8; 
Figure 10 shows different outputs of the synthetic 
image of Figure 9 from the filtering processor of Fig- 
ure 4 as the parameter a is varied from zero to one. 

Figure 2 illustrates a computer system 1 00 that im- 
plements an image processing system 1 30 (shown in 
Figure 3) within which a moire reduction module 133 
(shown in Figure 3) in accordance with one embodiment 
of the present invention may be implemented. Although 
Figure 2 shows some of the basic components of the 
computer system 100, it is neither meant to be limiting 
nor to exclude other components or combinations of 
components in the system. The image processing sys- 
tem 1 30 and the moire reduction module 133 will be de- 
scribed in more detail below, also in conjunction with 
- Figures 3 through 10. 

In one embodiment, the computer system 100 can 
be a personal computer, a notebook computer, a palm- 
top computer, a workstation, or a mainframe computer. 
In another embodiment, the computer system 100 can 
be a scan system that has some or all of the components 
of a computer system. 

As can be'seen from Figure 2, the computer system 
100 includes a bus 101 for transferring data and other 
information. The computer system 100 also includes a 
processor 102 coupled to the bus 101 for processing 
data and instructions. The processor 102 can he any 
known and commercially available processor or micro- 
processor. A memory 104 is also provided in the com- 
puter system 100. The memory 104 is connected to the 
bus 1 01 and typically stores information and instructions 
to be executed by the processor 1 02. The memory 1 04 
may also include a frame buffer (not shown in Figure 2) 
that stores a frame of bitmap image to be displayed on 
a display 121 of the computer system 100. 

The memory 1 04 can be implemented by various 
types of memories. For example, the memory 104 can 
be implemented by a RAM (Random Access Memory) 
and/or a nonvolatile memory. In addition, the memory 
104 can be implemented by a combination of a RAM, a 
ROM (Read Only Memory), and/or an electrically eras- 
able and programmable nonvolatile memory. 

The computer system 100 also includes a mass 
storage device 1 07 connected to the bus 101. The mass 
storage device 107 stores data and other information. 
In addition, the mass storage device 107 stores system 
and application programs. The programs are executed 
by the processor 1 02 and need to be downloaded to the 
memory 104 before being executed by the processor 
102. 

The display 121 is coupled to the bus 101 for dis- 
playing information to a user of the computer system 



100. A keyboard or keypad input device 122 is also pro- 
vided that is connected to the bus 101. An additional 
input device of the computer system 1 00 is a cursor con- 
trol device 1 23, such as a mouse, a trackball, a trackpad, 
5 or a cursor direction key. The cursor control device 1 23 
is also connected to the bus 101 for communicating di- 
rection information and command selections to the proc- 
essor 102, and for controlling cursor movement on the 
display 1 21 . Another device which may also be included 
10 in the computer system 100 is a hard copy device 1 24. 
The hard copy device 124 is used in the computer sys- 
tem 100 to print text and/or image information on a me- 
dium such as paper, film, or similar types of media. 
In addition, the computer system 100 includes an 
is image scanner 125. The image scanner 1 25 is used to 
convert an original document 140 (shown in Figure 3) 
into a digitized image which can be further processed 
by the computer system 1 00. The original document 1 40 
is the original physical document that contains picture 
20 and/or text. The original document 1 40 may include half- 
tone images, continuous tone images, and text images. 

In one embodiment, the image scanner 1 25 is a fax 
machine-type image scanner that has a scan region of 
one scan line wide. The length of the scan region is the 
2S width of the scan line. In this case, the scan head of the 
image scanner 125 simultaneously images the entire 
scan line. A document feed mechanism is provided to 
advance the original document 140 after each scan. In 
another embodiment, the image scanner 125 is a copi- 
30 er-type image scanner that has a relatively large scan 
region. For this type of scanner, the original document 
140 is placed against the scan window of the scanner 
and the scan head of the scanner moves in one direction 
after each scan. 
3s The computer system 100 also includes other pe- 
ripheral devices 126. These other devices 126 may in- 
clude a digital signal processor, a MODEM (modulation/ 
demodulation), and/or a CD-ROM drive. In addition, the 
computer system 100 may function without some of the 
40 above described components. 

As described above, the computer system 100 in- 
cludes the image processing system 1 30 (shown in Fig- 
ure 3) which includes the moire reduction module 133 
(also shown in Figure 3). 
45 As can be seen from Figure 3, the image processing 
system 1 30 includes a scan control application program 
1 32 and an imaging application program 1 34 : in addition 
to the moire reduction module 133. The programs 132 
and 134 are typically stored in the mass storage device 
50 107 of the computer system 100 (Figure 2). These pro- 
grams are loaded into the memory 1 04 from the mass 
storage device 107 before they are executed by the 
processor 1 02. 

The scan control program 1 32 interfaces with the 
55 scanner 1 25. The function of scan control program 1 32 
is to control the scanning operation of the scanner 125 
and to receive the pixel data of the scanned halftone 
image of the original document 140 from the scanner 
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125. As described above, the document 140 is a half- 
tone image document. The scan control program 1 32 is 
typically a scanner driver program tor the scanner 125. 
In one embodiment, the scan control program 1 32 is the 
HP DeskScan application program manufactured and s 
sold by Hewlett-Packard Company of Palo Alto, Califor- 
nia. Alternatively, the scan control program 132 can be 
any known scanner driver program. 

The scan control program 132 interfaces with the 
moire reduction module 1 33 which in turn interfaces with 10 
the imaging program 134. The imaging program 134 is 
used to process the scanned halftone image of the half- 
tone image document 140 so that the scanned halftone 
image can be displayed on the display 1 21 or printed by 
the hard copy device 1 24. The imaging program 1 34typ- ts 
ically includes a device-specific image driver program. 
For example, the imaging program 1 34 can include a 
known display driver program or a known printer pro- 
gram. 

In one embodiment, the imaging program 1 34 is the 20 
EasyPhoto imaging program manufactured and sold by 
Storm Technology, Inc. of Mountain View, California, in 
another embodiment, the imaging program 1 34 is the 
PhotoShop imaging program manufactured and sold by 
Adobe Systems, Inc. of Mountain View, California. Al- 25 
ternatively, the imaging program 1 34 can be any other 
known image processing application program. 

As can be seen from Figure 3, the moire reduction 
module 133 interfaces with the scan control program 

1 32 and the imaging program 1 34. The moire reduction 30 
module 1 33 receives the pixel data of the scanned im- 
age of the original document 140 from the scan control, 
program 132. Alternatively, the moire reduction module 

1 33 can be a functioning module that interfaces with the 
imaging application program 1 34. In this case, the moire 3S 
reduction module 1 33 is accessed after the pixel data 
has been transferred from the scan control program 1 32 

to the imaging program 1 34. 

As described above, the original document 1 40 may 
include halftone images, continuous tone images, and *o 
text images. Therefore, the scanned image of the doc- 
ument 140 may include scanned halftone images, 
scanned continuous tone images, and scanned text im- 
ages. As also described above, moire patterns are typ- 
ically introduced to the scanned halftone image of a half- 45 
tone image during scanning of the halftone image. 

In accordance with one embodiment of the present 
invention, the moire reduction module 133 first deter- 
mines if a pixel of the scanned image of the document 
140 appears to belong to the scanned continuous tone so 
images. If so, the moire reduction module 133 does not 
process the pixel and the pixel value of the pixel is left 
unchanged. This causes details of the scanned contin- 
uous tone images of the scanned image of the docu- 
ment 140 to be preserved. ss 

If the pixel appears not to belong to the scanned 
continuous tone images, the moire reduction module 
1 33 processes the pixel using a modified median filter 



(i.e., the filtering processor 142 of Figures 4 and 8) to 
minimize moire patterns in the scanned halftone images 
of the scanned image. The filter window of the modified 
median filter is designed such that pixels belonging to 
the scanned text images of the scanned image of the 
document 140 are typically passed through unchanged. 
This allows the moire reduction module 1 33 to minimize 
the moire patterns occurred in the scanned halftone im- 
ages of the scanned image without reducing the reso- 
lution of the scanned continuous tone and text images 
of the scanned image. This means that the moire reduc- 
tion module 133 reduces the moire patterns in the 
scanned halftone images of the document 140 without 
blurring the scanned image. The moire reduction mod- 
ule 1 33 will be described in more detail below : also in 
conjunction with Figures 4-10. 

Referring now to Figure 4, the moire reduction mod- 
ule 1 33 includes a buffer 141 and the filtering processor 
142 connected to the buffer 141. The buffer 141 is used 
to store the pixel data of the scanned image from the 
scan control program 1 32 before the pixel data are proc- 
essed by the filtering processor 142. The storage ca- 
pacity of the buffer 141 depends on the design of the 
filter window of the filtering processor 142. 

In one embodiment, the storage capacity of the buff- 
er 141 is such that allows at least three scan lines of 
pixel data to be stored in the buffer 1 41 at the same time. 
Alternatively, the storage capacity of the buffer 141 can 
be larger or smaller, depending on the design of the fil- 
tering processor 1 42. 

In one embodiment, the filtering processor 142 em- 
ploys a non-recursive filtering operation. This means 
that even though a new pixel value is calculated for a 
pixel, the original pixel value of that pixel instead of the 
calculated new value is used for later computations of 
succeeding pixels. In another embodiment, the filtering 
processor 142 employs a recursive filtering operation. 

The filtering processor 142 can be implemented as 
a software program run by the processor 102 (Figure 2) 
or in the form of discrete hardware or firmware. When 
the filtering processor 1 42 is implemented as a software 
program, the buffer 141 can be implemented by the 
memory 104 (Figure 2). When the filtering processor 
142 is implemented in the form of discrete hardware or 
firmware, the buffer 141 can be implemented by a dis- 
crete memory or memory 104. 

The filtering processor 142 is used to process the 
pixel data of the scanned image of the documenl 140 
(Figure 3). Again and as described above, the scanned 
image of the document 140 includes scanned halftone 
images, scanned continuous tone images, and scanned 
text images. In accordance with one embodiment of the 
present invention, the filtering processor 142 processes 
the scanned halftone images of the scanned image to 
minimize the moire patterns in the scanned halftone im- 
ages. Meanwhile, the filtering processor 142 typically 
leaves the pixel data of the scanned continuous tone 
and text images unchanged such that resolution of the 
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scanned image of the document 1 40 is not reduced. The 
filtering processor 142 is essentially a modified median 
filter with a specially designed filter window (i.e., filter 
window 160). Figure 6 shows the filter window 160 of 
the filtering processor 142, which will be described in 
more detail below. Figure 8 shows the operation of the 
filtering processor 142, which will also be described in 
more detail below. 

Briefly, the filtering processor 142 selects a pixel to 
process (hereinafter referred to as the sample pixel). 
Then the filtering processor 1 42 obtains a number ot ad- 
jacent pixels of the sample pixel that fall within the filter 
window of the filtering processor 1 42. The filter window 
is centered at the sample pixel and is used to define 
which pixels are the adjacent pixels of the sample pixel 
that are to be used to compute a new pixel value for the 
sample pixel. The filtering processor 142 then deter- 
mines if the sample pixel appears to belong to the 
scanned continuous tone images by determining if the 
sample pixel is similar to the selected adjacent pixels. If 
so, the sample pixel passes through the filtering proc- 
- essor 1 42 unchanged. If the sample pixel is significantly 
different from at least one adjacent pixel (i.e., the sample 
pixel does not appear to belong to any continuous tone 
image), the filtering processor 142 replaces the pixel 
value of the sample pixel with the pixel value of a median 
pixel among the adjacent pixels and the sample pixel. 
The filter window of the filtering processor 142 is de- 
signed such that the median pixel is the sample pixel if 
the sample pixel appears to belong to the scanned text 
features that need to be preserved. This albws the sam- 
ple pixel to typically pass through the filtering processor 
142 unchanged when the sample pixel belongs to the 
scanned text images. The median pixel" is a pixel that 
has a center pixel value among a number of pixels when 
the number of pixels are arranged or sorted in an as- 
cending order. The pixel value of the median pixel is 
hereinafter referred to as the median pixel value. 

The shape and size of the filter window of the filter- 
ing processor 142 determines which signals or pixels 
can pass through the filtering processor 1 42 unchanged 
(i.e., root signals). Figure 6 shows the shape and size 
of the filter window 1 60 of the filtering processor 142 that 
passes through the scanned text image pixels un- 
changed in accordance with one embodiment of the 
present invention, which will be described in more detail 
below. 

In one embodiment, the size of the filler window of 
the filtering processor 1 42 is three pixels long and three 
pixels wide. This allows the filtering processor 142 to 
require modest computation and memory space while 
the desired structural constraints of the filtering proces- 
sor 142 can still be obeyed. Alternatively, the filler win- 
dow of the filtering processor 1 42 can be larger or small- 
er than 3X3 pixels. 

As is known, a median filter preserves its root sig- 
nals. This means that the median filter does not filter out 
certain signals or image features when filtering out im- 



pulsive signals. The root signals can also be referred to 
as the structural constraints of the median filter. 

As described above, the filtering processor 142 is a 
modified median filter that minimizes the moire patterns 

s in the scanned halftone image of the document 140 (Fig- 
ure 3) without reducing the image resolution of the 
scanned continuous tone and text images of the docu- 
ment 140. This means that the filtering processor 142 
needs to pass pixel data of text, lines, and edges of the 

10 scanned image unchanged. Therefore, the desired 
structural constraints (i.e., root signals) of the filtering 
processor 142 should include straight lines (e.g., hori- 
zontal and vertical lines). 

In addition, the deseed structural constraints of the 

15 filtering processor 1 42 should also include comers in or- 
der to produce sharp text. The reason the corners and 
straight lines are selected as the desired root signals for 
the filtering processor 142 is that those elements are 
most common in text and line drawings. In addition, hu- 

20 man vision tends to be slightly more sensitive in hori- 
zontal and vertical directions. Figures 5 A through 5F 
show some of the desired structural constraints for the 
filtering processor 142 of Figure 4. It is to be noted that 
any filter that contains the signals of Figures 5A-5F as 

25 root signals will also contain horizontal and vertical edg- 
es as root signals. It is, however, to be appreciated that 
the desired root signals of the filtering processor 1 42 
may include other types of image features. For example, 
the root signals may include diagonal lines and/or edg- 

30 es. 

As can be seen from Figures 5A-5F, each of the root 
signals 151 through 156 is shown within a 3 x 3 pixel 
window. For each of those root signals 1 51 - 1 56, the pix- 
el value of the respective center pixel (i.e., the pixel 

35 151a, 152a, 153a, 154a, 155a, or 156a) can not be 
changed when passing through the filtering processor 
142 (Figure 4) in order to preserve the respective root 
signal. This means that, for example, if the filtering proc- 
essor 142 of Figure 4 learns that the received pixel is 

40 the pixel 151a, the filtering processor 142 passes the 
pixel 151a unchanged because the pixel 151a belongs 
to the root signal 151. 

Referring back to Figure 4, in order for the filtering 
processor 142 to preserve the root signals 1 51 -156 (Fig- 

45 ures 5A-5F), the filter window of the filtering processor 
142 needs be shaped such that the filtering processor 
142 can pass through the root signals 1 51 -156 (Figures 
5A-5F) unchanged. In accordance with one embodi- 
ment of the present invention, the filter window of the 

so filtering processor 1 42 is the cross-shaped five-pixel fil- 
ter window 160, as shown in Figure 6. As can be seen 
from Figure 6, the filter window 160 has a horizontal pix- 
el window 160a and a vertical pixel window 160b inter- 
secting the horizontal pixel window 160a to form the 

55 cross-shaped filter window 160. By having the cross- 
shaped filter window 160, the median pixel calculated 
by the filtering processor 142 of Figure 4 is always the 
center pixel P 5 for those root signals 151-156 (Figures 
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5A-5F). This means that the filtering processor 142 does 
not change the pixel value ot the center pixel P 5 of the 
filter window 1 60 if the center pixel belongs to one of the 
root signals 151-156. In addition, the cross-shaped filter 
window 160 also minimizes computation and memory 
requirement of the filtering processor 142 ot Figure 4. 
The center pixel P 5 in the filter window 160 is the pixel 
that needs to have its value calculated by the filtering 
processor 142, using the pixel within the cross-shaped 
filter window 160. 

Alternatively, the filter window of the filtering proc- 
essor 1 42 can have other shapes. For example, the filter 
window of the filtering processor 142 can have a 3 x 3 
weighted filter window, where the center pixel within the 
window has a weight of three units while each of the 
other eight pixels has only one unit weight. Moreover, 
the shape of the filter window 160 (Figure 6) can be an 
M X U shape in order to reproduce diagonal structures. 

However, as can be seen from Figure 6, the cross- 
shaped filter window 160 causes the filtering processor 
142 (Figure 4) to require minimized computation be- 
cause there are only five pixel values within the window 
160 for median calculations. This has the advantage 
over other types of 3 X 3 pixel windows (e.g., the 3 X 3 
weighted pixel window). 

Figure 7 shows how the cross-shaped filter window 
160 of Figure 6 is slid through pixels of the scanned half- 
tone image. As can be seen from Figure 7, three scan 
lines (i.e., scan lines 161-163) of pixels are shown. 
When the pixel q 7 is to be processed, the cross-shaped 
filter window 160 of Figure 6 places the q 7 pixel at its 
center and selects the pixels c^, q6. Qs= and °.12 for 
processing. Then the cross-shaped filter window 160 is 
slid to place the pixel q 8 as the center pixel of the filter 
window. In this case, the filter window 160 selects the 
pixels q 3 , q 7 , q 9 , and q 13 . The filter window 160 then 
continues until the end of the scan line 162 is reached. 

The operation of the filtering processor 142 of Fig- 
ure 4 is now described in more detail, in conjunction with 
Figures 6 and 8. As can be seen from Figure 8, the op- 
eration starts at step 180. At Step 181 , a variable ERR 
is set to zero. The variable ERR is the running total over 
the image of the difference between the output pixel val- 
ues and the corresponding input pixel values. At step 
182, a pixel P N is received tor processing. The P N pixel 
is the pixel P 5 shown in Figure 6. Then step 183 is per- 
formed at which the filtering processor 142 (Figure 4) 
determines the adjacent pixels P^ through P H . A of the 
P N pixel (i.e., the P^ through P 4 pixels) based on the 
cross-shaped filter window 160. At step 184, the filtering 
processor 1 42 determines if the absolute difference be- 
tween the pixel value of any one of the P^ through P 4 
pixels and that of the P 5 pixel is greater than a prede- 
termined value T The effect of this step is to determine 
if the P 5 pixel appears to belong to the scanned contin- 
uous tone images of the scanned image. The filtering 
processor 142 (Figure 4) determines if the P 5 pixel ap- 
pears to belong to the scanned continuous tone images 



of the scanned image by determining if the P 5 pixel is 
similar to its adjacent pixels P-, through P 4 . 

The predetermined value T determines the level or 
threshold at which the filtering processor 142 starts to 

s process the pixels to reduce the moire patterns on the 
scanned halftone image. Larger T values cause too 
many moire artifacts or patterns to pass through the fil- 
tering procesor 142 unchanged, while smaller T values 
remove some of the fine details of the scanned contin- 
ue uous tone image, making the image more blurred. 

In one embodiment, each pixel value supplied to the 
filtering processor 142 is represented by an 8-bit image 
data. In this case, each pixel of the scanned halftone 
image can take on any value between zero and two hun- 

15 dredfifty five (i.e., 255), with the lowest value represent- 
ing the darkest pixel. For this type of data, the T value 
can be selected from zero to two hundred fifty-five. 

However, it has been found that when the T value 
is selected to be approximately twenty, considerable 

20 moire reduction can be achieved by the filtering proces- 
sor 142 while retaining high resolution details of the 
scanned continuous tone image. 

In one embodiment, the T value is selected to be 
twenty. In other embodiments, the T value can be larger 

25 or smaller than twenty. 

If, at step 184, it is determined that the pixel value 
of at least one of the P 1 through P 4 pixels is different 
from that of the P 5 pixel by more than the predetermined 
value T, then step 185 is performed. If not, steps 

30 185-187 are skipped. 

At step 1 85, the pixels P 1 through P 5 are sorted and 
arranged according to their pixel values. This means if, 
for example, P., > P 3 > P., > P 5 > P 4 is true, these pixels 
will be arranged in that order. Here V N equals P 2 and V-, 

35 equals P 4 . Then at step 1 86, the new pixel value V of 
the P 5 pixel is obtained in accordance with the equation 

V=V (N + 1)<2 -cxXERR 

40 

Here V (N+1)/2 represents the median pixel of the 
sorted pixels P 1 through P 5 . The steps 185 and 186 rep- 
resent the median filtering operation of the filtering proc- 
essor 1 42. 

45 As described above, the filter window 1 60 of Figure 
6 allows the filtering processor 142 to pass pixels that 
appear to belong to the scanned text images (i.e., the 
root signals 151-156) unchanged when processing the 
pixels of the scanned halftone images to minimize the 

so moire patterns. Therefore, if the P 5 pixel appears to be- 
long to a scanned text image (i.e., belongs to one of the 
root signals 1 51 -1 56 of Figures 5A-5F), the median pixel 
v (N+i)/2 is calculated to be the P 5 pixel at steps 185 and 
186 due to the cross-shaped filter window 160 of the 

55 filtering processor 142. This thus retains details of the 
scanned text images of the scanned image of the doc- 
ument 140 by the filtering processor 142 (Figure 4). 
Then step 187 is performed to update the variable 
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ERR. Then step 188 is performed to determine if there 
are any more pixels of the scanned image to be proc- 
essed. If so, step 182 is repeated. Otherwise, the oper- 
ation ends at step 189. Pixels are typically processed in 
raster order, where each scanned image row is proc- s 
essed from left to right and the rows are processed in 
order from top to bottom. 

As described above, the parameter a should be 
chosen to ensure that the local pixel average of the out- 
put image from the filtering processor 142 stays close 10 
to the local average of the scanned halftone images. 
This feeding forward of the error allows periodic dot 
structures more than three pixels apart to be smoothed Claims 
somewhat even though the filter window 160 (Figure 6) 
of the filtering processor 142 (Figure 4) is only three pix- 
els long and three pixels wide. The parameter a is se- 
lected between zero and one. This is because a values 
greater than one typically cause the filtering processor 
142 to increase high frequency moire patterns rather 
than reducing them, while a values less than zero make 
the filtering processor 142 unstable in the sense that the 
output can become unbounded for a bounded input sig- 
nal. For a value that is between zero and one, a smaller 
a value causes the filtering processor 1 42 to perform the 
most smoothing but will produce the most error between 
the average input value and the average output value. 
Larger a values cause the filtering processor 1 42 to pre- 
serve the average gray level with more accuracy, but 
will cause the' filtering processor 142 not to filter out 
much of the high frequency moire patterns. Larger a val- 
ues will also cause the filtering processor 142 to adjust 
more rapidly to changing data statistics than small a val- 
ues. Figure 9 shows a synthetic image 1 90 to illustrate 
more precisely the effect of the parameter a on the out- 
put of the filtering processor 142 of Figure 4. Figure 10 
shows the effect of varying a on the image of Figure 9. 

As can be seen from Figure 9, the synthetic image 

1 90 has a constant gray value of 50 with the exception 
of one row (i.e., the row 191). For the row 191, every 
other pixel value is 200 (i.e., substantially white). When 
this image 1 90 is used as the input signal to the filtering 
processor 142, the waveform of that input signal is 
shown in Figure 10 (i.e., the input signal). In this case, 
only the non-constant row 191 will be changed. Figure 
1 0 shows how the output row of the non constant row 45 

191 (Figure 9) varies due to different a values. As can 
be seen from Figure 10, when the a value equals zero, 
the filtering processor 1 42 of Figure 4 does not have any 
forward feeding. When the a value equals one, the fil- 
tering processor 142 feeds the entire row forward and $o 
simpiy reproduces the row 191 shifted to the right by 
one pixel. As can be seen from Figure 10, when a is 
approximately equal to 0.25, good output results can be 
obtained. This is also true for most images. 

The moire reduction module 1 33 (Figure 3) as de- 55 
scribed thus far is for processing monochrome image 
data. This, however, can be easily extended to process 
color images as Well. One way of extending the moire 



reduction module 133 to process color images is to sim- 
ply apply the module 133 to each scanned color plane 
separately. Another way of doing this is to transform the 
color image from the red-green-blue color combination 
to a luminance-chrominance color domain and operate 
on one or more transformed color planes. 

The disclosures in United States patent application 
no. 08/654,492, from which this application claims pri- 
ority, and in the abstract accompanying this application 
are incorporated herein by reference. 
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A method of processing a scanned image (140) 
formed of a scanned halftone image and a scanned 
text image, comprising the steps of: 

(A) providing a filter window (160) for a modified 
median filler which allows the modified median 
filter (142) to pass through image of the 
scanned text image substantially unchanged; 

(B) using the modified median filter (142) to 
process image pixels of the scanned image 
(160) such that moire pattern in the scanned 
halftone image is minimized while the resolu- 
tion of the scanned text image is retained. 

A method as in claim 1 , wherein the filter window 
(160) is a cross-shaped window which includes a 
horizontal pixel window (160a) and a vertical pixel 
window (1 60b) intersecting the horizontal pixel win- 
dow. 

A method as in claim 2, wherein each of the hori- 
zontal and vertical pixel windows (160a, 160b) has 
a window span of three image pixels. 

A method of processing a scanned image (140) 
formed of a scanned halftone image, a scanned text 
image, and a scanned continuous tone image, com- 
prising the steps of: 

(A) providing a modified median filter (1 42) hav- 
ing a crossshaped filter window (1 60) which al- 
lows the modified median filter (142) to pass 
through image pixels of the scanned text image 
substantially unchanged; 

(B) determining if an image pixel (P 5 ) of the 
scanned image (140) appears to belong to the 
scanned continuous tone image; 

(C) if the image pixel (P 5 ) appears to belong to 
the scanned continuous tone image, then not 
processing the image pixel (P 5 ) using the mod- 
ified median filter (142); 

(D) if the image pixel (P 5 ) does not appear to 
belong to the scanned continuous tone image, 
then sending the image pixel (P 5 ) and a number 
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of adjacent pixels (Pt-P 4 ) which fall within the 
cross-shaped filter window (160) to the modi- 
fied median filter (142) such that moire pattern 
in the scanned halftone image is minimized 
without reducing the resolution of the scanned 
image (140). 

5. A method as in claim 4, wherein step (B) is per- 
formed by determining if the pixel value of the image 
pixel (P 5 ) is different from that of at least one of the 
adjacent pixels (PyP 4 ) by more than a predeter- 
mined value (T). 

6. A method as in claim 5, wherein the predetermined 
value (T) is approximately twenty while the pixel val- 
ue of each image pixel of the scanned image (140) 
can range from zero to two hundred fifty five. 

7. A method as in claim 4, 5 or 6, wherein step (D) 
comprises the sleps of: 

(I) determining which one ol the adjacent pixels 
(P r P 4 ) and the image pixel (P 5 ) has the medi- 
an pixel value (V( N+1 j /2 ) ) wherein when the im- 
age pixel (P 5 ) appears to belong to the scanned 
text image, the image pixel (P 5 ) has the median 
pixel value (V (N+1)/2 ); 

(II) subtracting an error value (ERR) multiplied 
by a predetermined parameter (a) from the me- 
dian pixel value (V( N+1 )/2 ), wherein the error val- 
ue (ERR) is initially set at zero; 

(III) changing the pixel value of the image pixel 
(P 5 ) to the subtracted median pixel value (V); 

(IV) updating the error value (ERR) for a next 
image pixel by adding the difference between 
the original pixel value of the image pixel (P 5 ) 
and the subtracted median pixel value (V) to the 
error value (ERR). 

8. A method as in claim 7, wherein the predetermined 
parameter (a) is selected from a range of 0.2 to 0.4 
or is approximately 0.25. 

9. A method as in any one of claims 1 to 8, further com- 
prising the steps of: 

(E) determining if the scanned halftone image 
has al leasl one more unprocessed image pix- 
el; 

(F) if the scanned halftone image is determined 
to have at least one more unprocessed image 
pixel, then returning to the step (B). 

10. Image processing apparatus (133) for a scanned 
image including a scanned halftone image and a 
scanned text image, comprising: 

(A) a modified median filter (142) having a fil- 
ter window (160) operable to allow the modified me- 



dian filter (142) to pass through image pixels of the 
scanned text image substantially unchanged when 
the modified median filter (142) minimizes moire 
pattern in the scanned halftone image such that the 
s moire pattern is minimized without reducing the res- 
olution of the scanned image (140). 
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(57) An image processing arrangement is described 
that minimizes moire patterns in scanned halftone im- 
ages (140) of 'a scanned image while maintaining the 
resolution of the scanned image. The arrangement in- 
cludes a filtering processor that has a modified median 
filter (142) with a specially shaped (e.g., cross-shaped) 
filter window (160). The filter window (160) allows the 
modified median filter ( 1 42) to preserve scanned text im- 
ages of the scanned image when processing the 



scanned halftone images to minimize the moire pat- 
terns. In addition, the filtering processor determines if 
an image pixel of the scanned image appears to belong 
to scanned continuous tone images of the scanned im- 
age prior to processing the image pixel. The filtering 
processor does not process that image pixel and the pix- 
el value of that image pixel is left unchanged if the image 
pixel appears to belong to the scanned continuous tone 
images. 
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